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Abstract. - It is shown how to derive simple polynomial expressions for the variational con- 
figurational entropy starting from the cluster variation method (CVM). As an example, first six 
terms of the expansion of the entropy in powers of the nearest-neighbour (NN) short-range order 
(SRO) parameter are obtained for the NN Ising ferromagnet on the face-centered cubic lattice 
using the tetrahedron (T-CVM) approximation. Calculated values of the transition temperature 
and the NN SRO parameter at the transition converge rapidly to their T-CVM counterparts as 
order of the approximation increases. 



The cluster variation method (CVM) proposed originally by Kikuchi fl and later refor- 
mulated, further developed and applied to a broad range of problems by many authors (for 
reviews, see Q-Q), is at present a standard and well-established technique for quantitative 
calculations of finite-temperature properties of systems undergoing order-disorder transitions. 
The CVM is essentially a procedure for obtaining approximate analytical expressions for the 
variational configurational entropy S. The CVM entropy is written in terms of probabilities of 
finding various possible atomic (spin) configurations on lattice clusters belonging to some basic, 
or maximal, cluster. A particular CVM approximation for the entropy is therefore defined by 
the choice of the basic cluster. The second necessary ingredient, the internal energy E, is 
the statistical average of the Hamiltonian of the problem, and is a function of the same (or 
related) variables as the entropy. The resulting variational free energy F = E — TS (T is the 
absolute temperature) is then minimized with respect to all configurational parameters. This 
can be done using probabilities which correspond to the basic cluster. However, they are not 
independent, since the sum of the probabilities of all possible configurations on the basic cluster 
is equal to unity. This condition is explicitly taken into account during the minimization; the 
obtained equations can then be solved by means of the natural iteration method of Kikuchi Q . 
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Alternatively, the set of independent variables (spin averages) is chosen S . The value of F at 
the minimum coincides with the actual approximate free energy of the system. 

Being a reliable and widely used theoretical tool, the CVM at the same time has certain 
disadvantages. One of them is that the CVM approximations for the entropy are fairly 
complicated, especially for comparatively large basic clusters, and the number of independent 
variational parameters in the expression for F becomes progressively large with the increasing 
size of the basic cluster. As a result, the method is intrinsically numerical. The aim of the 
present study is to simplify the CVM thermodynamic treatment and find suitable formulae for 
the configurational entropy, thus making the variational free energy more tractable analytically. 
The general description of the proposed approach is followed by a particular, relatively simple 
example of the nearest-neighbour (NN) Ising ferromagnet on the face-centered cubic (FCC) 
lattice in the tetrahedron (T-CVM) approximation and by a preliminary test of the results 
obtained in this example case. 

We start from the exposition of the general idea leading to the simplification of the CVM. 
In what follows the Ising language is used, and the variational free energy is minimized with 
respect to the spin averages which are independent configurational parameters; all relevant 
cluster probabilities can be expressed in terms of these spin averages. The free energy thus 
depends on interactions v n (including the magnetic field) and spin averages . The equilibrium 
values of are determined from the minimization conditions 

dF 

The possibility of the CVM simplification proposed here is based on the fact that in most 
CVM approximations the configurational entropy contains significantly more minimization 
parameters than the internal energy. The latter is the statistical average of the Hamiltonian 

H = ^v n a n , (2) 

n 

where a n are some operators. In the theory of ordering these operators are products of the 
spin variables. The averages (f n of operators a n form a subset of the set {£ ra }- All other spin 
averages are denoted as \ n - The internal energy then depends on v n and <p n , while the entropy 
is a function of the spin averages only, but depends on both ip n and Xn- 

E = E({v n }, {(fi„}) = ^2 V n Lp n , S = S({lf n }, {Xn})- (3) 
n 

Eqs. (p now become 

OS Vn os =o 



Otfn T ' OXn 

It is seen that the minimization of the free energy with respect to the spin averages Xn reduces 
to the maximization of the entropy. Corresponding equations are simply the relations between 
different configurational parameters, since they contain no information about interactions in 
the system, and as such can be taken into account in the CVM entropy from the very beginning 
(for a given Hamiltonian and a given thermodynamic phase). They can be used to find the 
spin averages Xn &s functions of the spin averages (p n . The results are then substituted into the 
entropy, thus expressing it in terms of ip n . The resulting variational free energy also depends 
only on the spin averages ip n conjugated to the interactions v n . The number of remaining 
independent variational parameters is greatly reduced in comparison with the original CVM 
treatment; in particular, it is equal to the total number of distinct interactions, if all lattice 
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sites are equivalent (i.e., when there are no sublattices). In the widely used case of pairwise 
interactions this approach leads to the variational free energy which is a function of the point 
and pair spin averages. 

In itself the outlined approach is not very useful, since equations to be solved are usually 
rather complicated, and so would be the final expression for the entropy. This difficulty can be 
overcome by defining another set of parameters, the cumulants of the remaining spin averages 
(f n , and seeking the solutions of these equations (i.e., the expressions for the spin averages 
Xn) in the form of series expansions in powers of the cumulants of the pair and higher-order 
spin averages tp n . These expansions are then substituted into the CVM approximation for 
the entropy, and the entropy itself is also expanded in powers of the same parameters. The 
cumulants of the spin averages are defined as follows: the cumulant average of a product of 
n spin variables is the nth-order residue when all combinations of cumulant averages of lower 
order are subtracted from the actual average of the product. In other words, 

(si) = (s») c , (siSj) = (si) c (sj) c + {s i s J ) c , 
(siSjSk) = (si) c (sj) c (s k ) c + {s l s j ) c (s k ) c + (siS k ) c (sj) c + (sjS k ) c (si) c + {s i s J s k ) c , (5) 

etc. 0. Here Si is a spin variable attributed to the lattice site i, () c denotes the cumulant 
average, and () is the usual statistical average. By retaining first several terms in the expansion 
for the entropy a sufficiently simple polynomial approximation to the (already approximate) 
CVM expression is obtained. The cumulants used as expansion parameters are almost always 
sufficiently small to justify the expansion; the irreducible pair correlation function, whose 
matrix elements are the cumulants of the pair averages and are proportional to the corre- 
sponding short-range order (SRO) parameters, can serve as an example. The coefficients of 
the polynomial are functions of the point averages. The cumulants of the point averages are 
these averages themselves, i.e., the site magnetizations; they cannot be used as expansion 
parameters, since they are not necessarily small (e.g., in the ordered phase or in the case of 
sufficiently strong magnetic field above the transition). 

To illustrate the proposed approach, we consider the tetrahedron version of the CVM for 
the ferromagnetic FCC Ising model with NN pair interactions. In the T-CVM approximation 
the variational configurational entropy is (see, e.g., ^ or first of the reviews J2|) 

(Nkg)-^ = -5(P u \nP u +P d \nP d ) +6(P uu \nP uu + 2P ud \nP ud 

_^_pdd pdd^j 2 (puuuu |^ puuuu _j_ ^puuud puuud 

-^-QP uu dd J n puudd _|_ ^puddd puddd _|_ pdddd pdddd^ 

Here superscripts "u" and "d" stand for spins up and down, N is the number of lattice sites, 
and fcg is the Boltzmann constant. The entropy is expressed in terms of probabilities P 
of one-, two- and four-spin configurations on the basic cluster - the NN tetrahedron. As was 
mentioned before, not all of the probabilities in eq. (((]) are independent. The set of independent 
parameters consists of four spin averages 

ii = (si) =m, & = (siSj) , £ 3 = (s^jSk) , £ 4 = (siSjSkSi) , (7) 

where m is the magnetization and all lattice sites are nearest neighbours. The probabilities in 
eq. (^) are statistical averages of the corresponding products of occupation numbers which are 
linearly related to the spin variables |2|]- j§], and thus can be expressed in terms of averages (0): 

2P u = 1 + TO) 2P d = 1 - m, 

4P UU = 1 + 2m + 6, 4P dd = 1 - 2m + £ 2 , 4P" d = l-£ 2 , 

16P UUUU _ X + 4m + + ^ + ^ m pdddd = 1 _ 4m + _ 4 £, + 
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16 puuud = 1 + 2m _ _ £ 4j IQpuddd =1-2771 + 2^3-^4, 16P uudd = 1 - £ 2 + £ 4 . (8) 

The Hamiltonian of the Ising model is 

H = --^JijSiSj -h^Si (9) 

ij i 

(Jij is the exchange integral equal to J > for NN sites and to zero otherwise, and h is the 
magnetic field), so that only first two averages (Q) enter the expression for the internal energy, 

N- 1 E=-±ZJ&-ht 1 , (10) 

where Z is the NN coordination number. As a result, the set {£ n } contains four averages, 
while its subset {ip n } consists of two variables £1 and £2- The minimization of the free energy 
with respect to £3 and £4 reduces to the maximization of the entropy with respect to these 
two variables and leads to the following equations: 

puuuu ^puddd^ pdddd ^puuud\ 2 puuuu pdddd ^ puudd\ ^ ^puuud puddd^ (H) 



From eqs. ( |ll[ ) the averages £3 and £4 can be found as functions of the averages £1 and £2- 
According to the proposed general scheme, £3 and £4 should be sought as series expansions in 
powers of the cumulant of the pair average £2- This cumulant is the NN matrix element of 
the irreducible pair correlation function. However, a quantity proportional to it, the NN SRO 
parameter a, is more often used. The relation between £2 and a is 

£2 = m 2 + (1 - m 2 )a. (12) 

By iteratively solving eqs. ( p"l| ) first six terms of the series expansions in powers of a for the 
spin averages £3 and £4 were found, 

£3 = «o + o-ia + a 2 a 2 + a 3 a 3 + a 4 a 4 + a 5 a 5 + a 6 a 6 + 0(a 7 ), (13) 
£4 = b a + b x a + b 2 a 2 + b 3 a 3 + 6 4 a 4 + b 5 a 5 + b 6 a 6 + 0(a 7 ), (14) 

where the coefficients a n and b n are 

ao = to 3 , a\ — 3m (l — to 2 ) , a 2 — —6m (l — to 2 ) , 
03 = 2to (5 — 9to 2 ) , a 4 = —6m (l — 9to 2 ) , a 5 = —54m (l — to 2 ) , 
a 6 = 2m (l - to 2 ) ^ (185 - 1491to 2 + 3051m 4 - 1809to 6 ) , 
60 = rn 4 , bi = 6to 2 (l — m 2 ) , b 2 — 3 (l — to 2 ) (l — 9to 2 ) , 
63 = -8 (1 - 15m 2 + 18to 4 ) , 64 = 24 (1 - 19to 2 + 36m 4 ) , 
65 = -24 (1 - m 2 y X (3 - 70to 2 + 267to 4 - 216to 6 ) , 
b 6 = 8 (1 - to 2 ) ^ (26 - 691to 2 + 4089to 4 - 6993to 6 + 3537to 8 ) . (15) 

Note that the expressions for the first four coefficients a n and b n coincide with the exact 
results obtained in the case of arbitrary pairwise interactions on the FCC lattice §. The 
tetrahedron CVM therefore correctly reproduces exact expansions for the averages £3 and £4 
up to at least third order in a; exact formulae for the higher-order coefficients are at present 
unavailable. Substitution of the expansions (|l3|) and ( |l4| ) into the orig inal T-CVM formula (§) 
and subsequent expansion of the entropy in powers of a gives 

S = S + S lt (16) 



I. TSATSKIS: SIMPLE APPROXIMATIONS FOR ENTROPY 



5 



(Nkg^So = - (±4pin±4f: + i=2i In ±^2) , (17) 
{Nk B y 1 S 1 = c 2 a 2 + c 3 a 3 + c 4 a 4 + c 5 a 5 + c 6 a 6 + <3(a 7 ), (18) 
C2 = -3, c 3 =4(l-m 2 )~ 1 (2-m 2 ) , c 4 = -0.5 (l - m 2 )~ 2 (37 - 66m 2 + 45m 4 ) , 
c 5 = 4.8 (l - to 2 )~ 3 (10 - 39m 2 + 52m 4 - 19m 6 ) , 
c 6 = -0.2 (1 - m 2 ) ~ 4 (641 - 3900m 2 + 7870m 4 - 6220m 6 + 1865m 8 ) . (19) 



As expected, the entropy is a sum of two terms, the mean-field (Bragg- Williams) approximation 
(MFA) contribution So and the correlation entropy Si . The mean-field part of the entropy 
is the zero-order term, the linear term vanishes, since the entropy is maximal in the case of 
uncorrelated spins, and the expansion of the correlation entropy starts from the quadratic 
term. Now the variational free energy is a very simple function of only two parameters m 
and a (instead of four variables (0))- The equilibrium values of these two parameters are the 
solutions of two minimization equations, 

dF dF 

|- = 0> 7T=°- (2°) 
am oa 

The obtained result (^) for the correlation entropy has especially simple form in the disor- 
dered phase with zero magnetic field. In this case first of eqs. ( po| ) leads to the vanishing 
magnetization, while second gives a as a function of a single parameter - the normalized 
temperature t = ksT/ZJ; the expansion ( |l8| ) has numeric coefficients: 

(Nks^Si = -3a 2 + 8a 3 - 18.5a 4 + 48a 5 - 128.2a 6 + 0(a 7 ) . (21) 

In the polynomial approximations for the entropy which can be obtained from the expan- 
sion (|l8|) by retaining finite number of terms, the highest-order term must always be the 
even-order one. Otherwise, from the positiveness of the third- and fifth-order coefficients in 
the expansion ( pl| ) it follows that in the disordered phase the approximate entropy does not 
decrease monotonically with increasing positive a, but has a minimum at some a value and 
begins to increase afterwards. As a result, the solution of the second of eqs. (^) disappears as 
temperature decreases, while at higher temperatures this equation has two solutions instead 
of one. On the other hand, all calculated even-order coefficients are negative, and no such 
difficulties occur. As a preliminary test of the expansion (|l8| ) for the correlation entropy 
and related approximations for the variational free energy obtained in the present study, 
we calculate the normalized transition temperature t c and the NN SRO parameter at the 
transition point a c . The transition temperature is defined by the condition d 2 F/dm 2 = 0, 
together with the minimization equations (^0[). Values of t c and a c calculated in the three 
available (second-, fourth- and sixth-order) approximations are given in Table [|. They clearly 
converge to the original T-CVM values, from above for t c and from below for a c ; for instance, 
the overestimation of t c changes from 20% in the MFA to 9% in the quadratic approximation, 
and then to 3% in the highest (sixth-order) approximation. 

In summary, we have proposed the method of obtaining simple polynomial approximations 
for the variational configurational entropy which is based on the widely used CVM. This 
method utilizes the fact that the CVM entropy usually depends on much greater number 
of variational parameters than the internal energy. The minimization of the free energy 
with respect to variables which do not enter the expression for the internal energy is thus 
equivalent to the maximization of the entropy. The corresponding equations do not contain 
any information about the Hamiltonian of the system and play the role of constraints relating 
different variational parameters. They are used for the elimination of the redundant variables. 
The number of the remaining independent variational parameters in the free energy is almost 
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Table I. - Normalised transition temperature t c = ksTc/ZJ and the NN SRO parameter at this 
temperature a c — a(t c ) in the three approximations for the variational free energy obtained from 
expansion for the correlation entropy. The MFA and T-CVM values, as well as corresponding 
ratios, are also shown for the purpose of comparison. Results for the transition temperature can be 
further compared with the best known value t c = 0.81638 fl/. 



Approximation 


t c 


t c /%- UVM 


a c 




MFA (Oth order) 


1 


1.197 








2nd order 


0.90825 


1.087 


0.09175 


0.459 


4th order 


0.87703 


1.050 


0.13930 


0.697 


6th order 


0.86205 


1.032 


0.16304 


0.815 


T-CVM 


0.83545 


1 


0.20000 


1 



always significantly reduced in comparison with the CVM. In the case of the absence of 
sublattices in the system it is equal to the total number of different interactions in the 
Hamiltonian (the magnetic field included). In practice this programme is implemented by using 
the expansion in powers of the cumulants of the remaining pair and higher-order spin averages: 
(i) the variables to be eliminated are found from the constraint equations as the corresponding 
series, (ii) the results are substituted into the initial CVM formula for the entropy, (iii) the 
obtained expression for the entropy is also expanded into the same series and (iv) finite number 
of terms in this expansion is retained. The resulting approximate free energy is a polynomial 
in the cumulants of the pair and higher-order spin averages conjugated to the interactions, 
i.e., present in the expression for the internal energy. The coefficients of the polynomial are 
functions of the (sub)lattice magnetization(s). The final expression for the free energy always 
has the same functional form, regardless of the particular CVM approximation used initially 
for the configurational entropy; only the coefficients of the polynomial change. The evolution 
of these coefficients with the version of the CVM is a matter of considerable interest and will be 
the subject of a separate study. As a particular example, the ferromagnetic FCC Ising model 
with NN pair interactions in the tetrahedron approximation has been considered. First six 
terms of the expansion of the configurational entropy in powers of the NN SRO parameter have 
been obtained. Calculated values of the transition temperature and the NN SRO parameter 
at this temperature rapidly converge to the corresponding original T-CVM results with the 
increasing order of the approximation. The detailed study of the applicability and accuracy of 
the obtained approximations for the free energy is in progress and will be published elsewhere. 

*** 
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